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(57) L’invention est un systeme de localisation, de 
navigation et d’evitement de collisions pour les navires, 
les aeronefs, les vehicules terrestres, etc. qui utilise une 
base de donnees orthophotographiques numeriques 
georeferencees et un signal de localisation (1) pour 
afficher sur un dispositif infographique stereoscopique 



(57) Herein is presented a positioning, navigation and 
collision avoidance system for ships, aircraft, land 
vehicles and the like, which utilizes a geo-referenced 
digital orthophotograph database (6) and a positioning 
signal (1) to display upon a computer stereo graphics 
device (15) a high visibility dynamic photographic 
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(15) une image photo graphique dynamique de 
Lenvironnement immediat de Lutilisateur, y compris les 
obstacles mouvants et stationnaires. Les donnees de 
localisation et les donnees temporelles, ainsi que les 
donnees de site georeferencees qui sont utilisees pour 
obtenir les orthophotographies numeriques peuvent 
servir a signaler a l’utilisateur les obstacles avoisinants 
et, facultativement, a etablir un dispositif semi- 
automatique d'evitement des collisions. En utilisant des 
coordonnees (x, y, z) et un temps (10) produits par 
Lutilisateur, le systeme peut fonctionner en mode 
statique comme simulateur de vol ou simulateur pour 
autre mode de transport. Avec V addition de couches de 
donnees numeriques georeferencees foumies par 
Lutilisateur, le systeme de Linvention peut egalement 
etre utilise comme outil de prise de decision mobile pour 
les systemes d’ information geographique. 



image of the user's immediate environment, including 
both moving and stationary 7 obstacles. The position and 
temporal data along with the geo-referenced elevation 
data utilized to derive the digital orthophoto graph(s) can 
serve to warn the user of nearby obstacles; and 
optionally, to implement semi-automatic avoidance. 
Substituting user generated x-y-z positions and times 
(10), the system may be used in a static mode as a flight 
simulator or a simulator for other modes of 
transportation,. The system may also be used as a 
molible Geographic Information Systems decision 
making tool with the addition of user supplied geo- 
referenced digital data layers. 
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REAL TIME THREE DIMENSIONAL GEO-REFERENCED 
DIGITAL ORTHOPHOTOGRAPH-BASED POSITIONING , 
NAVIGATION , COLLISION AVOIDANCE 
AND DECISION SUPPORT SYSTEM 

BACKGROUND OF THE INVENTION 

A. Field of the Invention . 

The present invention relates in general to 
geodesy, cartography and computer technology, and in 
particular to positioning systems, digital - 
orthophotographs and digital terrain elevation data, and 
Geographic Information Systems. 

B. Prior Art . 

A variety of computerized information display 
systems have been developed to function as simulators, 
vehicular obstacle avoidance systems, and vehicle 
tracking systems. Such systems use computer generated 
imagery based on data sets generated either from 
digitized contour maps or symbolic maps or combinations 
of both. Typically, such systems include some method of 
determining the mode of transportation 1 s location in 
space (utilizing "dead-reckoning" techniques using 
on-board sensors, transmitting beacons, a satellite 
positioning system, or combinations of these) and a 
method of displaying/updating the mode of 
transportation's location on a digitized symbolic map or 
chart using computer graphics. “ 

The major drawback in the aforementioned systems is 
the lack of realistic visual feedback displayed on a 
graphics monitor along with the mode of transportation's 
position. Artificially created geographic data (such as 
is found in flight simulators) or data derived from 
digitized cartographic contour /elevation maps lack the 
realism and true photographic detail of the geographic 
surroundings, such as vegetation and man-made structures 
such as buildings, power lines, etc. The use of 
symbolic maps or the addition of symbols to digitized 
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contour maps can provide some information with respect 
to man- made structures and vegetation, but to provide 
information density comparable to what would be observed 
by directly looking at a portion of the earth with the 
5 naked eye is not practically feasible by symbolic 

representation. In addition to the time intensive and 
costly process of making symbolic maps, many features 
cannot be accurately placed because of cartographic 
displacement caused by adjacent symbols. 

10 At present, there is no effective way operators of 

moving modes of transportation such as ships, aircraft 
or land vehicles can visually ascertain their and each 
other's positions, if there is no visibility, and be 
alerted to the proximity of obstructions. This was 
15 clearly demonstrated by the environmental disaster 

caused when the ship, the EXXON VALDEZ, ran aground at 
night in March of 1989 after leaving Valdez, Alaska, and 
leaked its load of approximately 11,000,000 gallons of 
crude oil upon the ocean. Other examples are the 
20 December 1990 collision of two Northwest Airlines 

passenger jets at the Detroit, Michigan, airport in a 
dense fog and the collision on February 1, 1991 at 
Los Angeles International Airport at night between a 
U.S. Air Boeing 737 and an Airwest commuter jet 
25 aircraft. In the former case, one airliner was lost and 
taxied on to an active runway and was hit by the other 
airliner as it was taking, off causing eight deaths, 
injuries and much damage. In the latter case, the U.S. 
Air Boeing 737 was mistakenly cleared to land on the 
30 runway being used by the Airwest commuter aircraft 

previously cleared for takeoff. The collision caused 
30 deaths. 

In order to provide background information so that 
the invention may be completely understood and 
35 appreciated in its proper context, and how it can 
prevent accidents like the ones described above,* 
reference may be made to a number of prior art patents 
as follows: 
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U.S. Patent Nos. 4,837,700; 4,835,537; 4,682,160 
and 4,829,304. 

A number of patents such as typified by U.S. Patent 
No. 4,837,700, to Ando et al. discloses a road vehicle 
5 navigation system using a Global Positioning System 
(GPS) receiver and odometer, angular rate, and 
geomagnetic sensors. A digitized map of the area is 
also displayed and scrolled by computer and the 
operator's position on the map is displayed as 
10 determined from the sensors or GPS signals.. Digitized 
symbolic maps or charts used with the above patent, and 
with vehicle, aircraft, and ship navigation and 
positioning systems, in general, suffer from a number of 
deficiencies. Symbolic maps or charts show only 
15 selected features and only as symbols, and the spaces 

between the symbols are left blank. Additionally, many 
features are not accurately placed on symbolic maps 
because of cartographic displacement caused by adjacent 
symbols. The digital maps used with the aforementioned 
20 systems make little, or no use of different digital data 
layers to develop (in a dynamic fashion) statistics and 
make new digital maps of the surrounding environment as 
position changes, or use geo— referenced terrain 
elevations to assess distances from obstacles and 
25 generate perspective views for added realism. The above 
patent makes no mention of transformations that must be 
made when displaying GPS geographic coordinates based on 
.•>•••• various X-Y map projections and spheroids. This can be 
a source of error. 

30 Remotely sensed digital satellite image data of the 

earth can also be used as a map or chart and the 
operator's position, displayed thereon through the use of 
GPS signals. 1 The image data are fitted to ground by 
rubber sheeting or warping the common image points in 
35 the image and their counterparts on an existing map or 
chart using their known positions on the ground. This 
gives a good fit at the registration points, but as one 
moves away from the registration points accuracy falls 
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off. Additionally, no provision is made to correct for 
relief displacement. These errors, and the small scale, 
limit the use of satellite imagery as a map or chart. 

U.S. Patent 4,835,537, to Manion, discloses an 
5 aircraft warning and avoidance system. All mobile 

obstacles whether aircraft or vehicles on the ground 
must be outfitted with radio telemetry devices that 
receive various TACAN and LORAN and preferably GPS 
positioning information and transmit their position 
10 based upon these incoming signals. Natural obstacles 

such as mountain peaks or man-made objects such as radio 
towers can also be outfitted with radio telemetry 
devices that broadcast their location. The pilot of an 
aircraft is shown a symbolic view of the instrumented 
15 objects around the pilot and audibly warned of impending 

collisions if the present course is maintained. The 
problem with this system is that not all aircraft and 
vehicles on the ground may always be instrumented with 
the costly telemetry transceivers. In addition, it 
20 would not be economically practical to instrument all 
natural objects with the transmitters. The cost of 
maintaining the instruments at each site in working 
order also needs to be considered. Distances are 
calculated between instrumented objects, fixed or mobile 
25 (transmitting their respective coordinates) , based upon 

latitude and longitude of the mode of transportation; 
rather than reduction to a map or chart coordinate 
system. Such an approach could lead to inaccuracies 
along the equator or in polar regions due to earth 
30 curvature. Again, as with the above patents, only a 

symbolic display is shown of the surrounding 
environment, and not realistic geo-referenced 
photographic quality imagery to guide the operator. 

U.S. Patents 4,682,160, to Beckwith et al., and 
35 4,829,304 to Baird, introduce a new component to 

navigation and aircraft navigation in particular, the 
use of digital geo-referenced terrain data. The former 
uses terrain elevations to generate a shaded relief 
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perspective view image in real time of the terrain, in 
consonance with pitch, roll and yaw of the aircraft, 
over which the aircraft is flying. The imagery 
displayed, however, is synthetic as it is derived by 
5 computer graphics shading techniques based upon adjacent 
elevation differences and does not show the landscape in 
true photographic detail, which is a primary object of 
the current invention. The latter uses various aircraft 
instruments such as a barometer, radar altimeter 
10 readings, and estimated position from the onboard 

navigation system to compare a sensed profile of digital 
terrain data to a corresponding profile of stored 
digital terrain data. When a match is found, the 
onboard navigation system is updated with the new 
15 position. Thus the piloted or automatic guidance 

(pilotless) mode of transportation is able to navigate 
and avoid obstacles. Again these two schemes use 
onboard sensors to determine position. Sensors 
accumulate error as distances increase between 
20 correlation points. Where there are no terrain 

differences, as over water, both systems would become 
unreliable as there would be no terrain profiles with 
which to correlate the stored terrain data. 

Additionally, in the latter system, barometric pressure 
25 can be influenced by current weather conditions and 

gusts of wind can disorient the mode of transportation 
and give erroneous radar altimeter readings. This makes 
'it ^difficult or impossible to obtain a reliable terrain 
profile with which to make a correlation with stored 
30 terrain data. Again, these systems do not show the 

pilot's position in a visual photographic image of the 
terrain or water over which the aircraft is flying. 

Present day training simulators for Various modes 
of transportation, particularly aircraft flight 
35 simulators and warfare mission planning systems and 

other devices such as video games, use artificially 
generated imagery for training or entertainment. 
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Computer simulated imagery detracts from the simulation 
and lacks the realism of photographic imagery. 

Geographic Information Systems (GIS) technology is 
now used with user input parameters to model various 
5 geo-referenced data sets in order to gain new 

information about the environmental relationships 
between various data sets. This is done in a static 
mode at a single site. In a dynamic situation such as a 
forest fire, it may not be obvious what to model at a 
10 distant office site based upon untimely user reported 
conditions in order to forecast the spread of the fire 
and the subsequent decisions that would have to be made 
to evacuate personnel and to allocate both personnel and 
resources to fight the fire. 

15 SUMMARY AMD OBJECTS OF THE INVENTION 

Whatever the precise merits, features and 
advantages of the above cited references, none of them 
achieves or fulfills the purposes of showing the 
operator or user of a mode of transportation, through 
20 the use of computer technology, his/her position 

dynamically in a geo-referenced digital Orthophotograph 
of the surrounding environment, and of warning the 
operator of nearby objects and other modes of 
transportation and presenting the operator with an 
25 attributed graphic display of the surrounding 

environment for implementation of user input parameters 
to develop new statistics and/or thematic displays of 
the environment or to implement new actions. 

Digital Orthophotographs are now becoming generally 
30 available to the public. Techniques are being perfected 

to perform -photocorrelation by computer of aerial 
photographs meaning that digital terrain elevation data 
will be derived directly from the aerial photograph 
using the appropriate computed algorithms. This has the 
35* important implication that custom Orthophotographs along 
with their associated digital terrain elevation data 
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will be increasingly easier and inexpensive to produce 
and update on a regular basis. 

What is truly novel about the use of digital 
Orthophotographs is that the user of a mode of 
5 transportation will be able to dynamically visualize 

his/her position in relation to the surrounding area in 
either two or three dimensions, through an appropriate 
display, regardless of the time of day and weather 
conditions, in photographic detail at map or chart 
10 accuracy standards. Oftentimes digital terrain 

elevation data are corrected so that vegetation and man- 
made objects do not affect the elevation values, but it 
should be mentioned that these corrections may not 
always be desirable depending on the application. For 
15 example, if a plane were flying at a very low altitude 
as would be the case near an airstrip, one would want 
the elevations of treetops, limbs, power poles, 
buildings, etc. , to be present in the digital terrain 
elevation data. 

20 Accordingly, it is a principal object of the 

present invention to provide greater realism and greater 
safety to operators of various modes of transportation 
by visually displaying their current position, as 
obtained from a Positioning System (PS) receiver (s) , 

25 upon a computer controlled graphics display device 
concurrently with a geo-referenced digital 
Orthophotographic map with a horizontal accuracy equal 
to a symbolic map or chart of the same scale and area. 
The graphics display realistically represents in 
30 photographic detail the surrounding environment in 

bright daylight regardless of whether it is day or night 
or whether there, are inclement weather conditions, and 
dynamically updates the position of the mode of 
transportation on the display as its position changes. 

35 In consonance with the above object, it is another 

object of the invention to provide greater safety 
through the use of geo-referenced digital terrain 
elevation and/or bathymetric sounding data (from which 



SUBSTITUTE SHEET 




PCT/US92/0$18(r"^ 

- 8 - 

the digital Orthophotograph was made) to warn operators 
of modes of transportation visually and/or audibly of 
nearby obstructions. 

In consonance with the above objects, it is another 
5 object of the invention to provide greater safety 

through the capability to transmit and receive 
positional, temporal and identification data from other 
modes of transportation and structures. This capability 
allows the operator to be informed of the presence of 
10 other modes of transportation and other potential 

obstructions that would not normally be included in the 
digital Orthophotographs and their associated elevation 
data . 

Furthermore, in consonance with the above objects, 

15 it is also an object to provide greater safety and 

greater viewing realism through the use of custom-made 
digital terrain elevation and/or bathymetric sounding 
data containing digitized man-made structures such as 
buildings, power lines, radio transmission towers, ,and 
20 the like, to warn the operators of modes of 

transportation of nearby man-made structures and to 
produce digital Orthophotographs from aerial photography 
exposed at progressively lower altitudes near arrival 
and departure points (and at other trajectory points 
25 where navigation is potentially dangerous) as would be 
the case, for example, in which an aircraft changes 
altitude in order to land and take off. 

Also, in consonance with the above objects, it is 
an object of the invention to provide greater analytical 
30 capabilities to trip recorders by saving the digital 

positions, directions, velocities, and temporal 
coordinates of modes of transportation generated by a 
Satellite Positioning System of other Positioning System 
to a digital file or trip recorder. This data can then 
35 be subsequently studied by correlating the stored 

positioning system spatial and temporal coordinates to 
their appropriate Orthophotographs to recreate the 
mission of the mode of transportation. 
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Again, in consonance with the above objects, it is 
another object to provide greater visual terrain realism 
to an operator of a mode of transportation with the use 
"of three dimensional stereo digital Orthophotographs 
5 based upon the accompanying elevation data used to make 
the Orthophotographs, and optionally to provide dynamic 
perspective terrain views where translations about the 
x-y-z axes of the mode of transportation are known and 
project these views to the operator through the use of 
10 various stereo display technologies. Such perspective 

views would also include remote views of the mode of 
transportation as seen from a virtual remotely located 
observer. In other words, the operator of a. mode of 
transportation could view in real-time, via the on-board 
15 display, his/her relationship to the surrounding area 

and other modes of transportation, with respect to the 
operator's craft/vehicle, as if he/she were looking 
through the eyes of an observer stationed at some chosen 
point remote from the craft /vehicle. 

20 In consonance with the above object, it is another 

object to provide greater visual terrain realism in 
static transportation training simulators , particularly 
flight simulators, and to provide greater terrain 
realism for military mission planning, tactical 
25 situations, and video games through the use of digital 
Orthophotographs which could be viewed in either two or 
three dimensions. 

In consonance with the above objects, it is another 
object of the invention to provide greater decision- 
30 making capabilities to the users of a mode of 
transportation , through the use of Geographic 
Information Systems technology to produce a dynamic and 
timely statistical analysis or digital data layer and/or 
thematic map or chart based upon the user's current 
35 position, digital Orthophotographs and digital terrain 
elevation and/or bathymetric sounding data and various 
other user-supplied geo-referenced digital data layers. 
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in accordance with an embodiment of the 
invention, a vehicle position tracking, 

5 navigational, collision-avoidance and decision 
support system, comprising positioning means for 
providing positional coordinate signals 
corresponding to spatial coordinates of a current 
position of a vehicle; computational means for 
10 accessing an image library of differentially 

rectified images for predefined geographic areas, 
indexed by spatial coordinates, and a data library 
of terrain elevational data of said predefined 
geographic areas, indexed by spatial coordinates; 

15 for receiving said positional coordinate signals, 

and for analyzing said positional coordinate signals 
by selecting said differentially rectified images 
from said image library and terrain elevational data 
from said data library; processing said positional 
20 coordinate signals, said selected differentially 

rectified images, and said terrain elevational data 
into resultant differentially rectified image 
signals corresponding to the current position and 
terrain of said vehicle; and display means 
25 responsive to said resultant differentially 
rectified image signals for translating said 
resultant differentially rectified image signals 
into visual, pictorial information corresponding to 
the current position and geographic surroundings of 
30 said vehicle. 

In accordance with another embodiment of 
the invention, a-method of tracking navigating , and 
collision-avoidance of a vehicle comprising the 
steps of obtaining positional coordinate signals 
corresponding to spatial coordinates of a current 
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5 position of a vehicle; accessing an image library of 
differentially rectified images of predefined 
geographic areas, indexed by spatial coordinates, 
and a data library of terrain elevational data of 
same said predefined geographic areas, indexed by 
10 spatial coordinates; analyzing said positional 

coordinate signals by selecting said differentially 
rectified images from said image library and terrain 
elevational data from said data library; processing 
said positional coordinate signals, said selected 
15 differentially rectified images, and said terrain 
elevational data into resultant differentially 
rectified image signals corresponding to the current 
position and terrain of said vehicle; and 
translating said resultant differentially rectified 
20 image signals into visual, pictorial information 

corresponding to the current position and geographic 
surroundings of said vehicle. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is. a ialdck diagram showing the apparatus 
needed to implement the most preferred embodiment of the 
invention. 

5 FIG. 2 is a block diagram showing logic flow 

through the apparatus shown in FIG. 1 for implementation 
of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
Before proceeding with a detailed description of 
10 the present invention, a number of definitions - are 
presented, and are herein incorporated into this 
description by reference, so that the invention can be 
better understood and appreciated. 

Positioning System fPS^ . A group of transmitters 
15 emitting coded identification and timing signals such 

that a commercially available PS receiver can decode, 
and through look-up tables, determine and broadcast the 
position of the receiver twenty-four hours a day all 
year around on a dynamic basis. In many cases, the most 
20 likely candidate for a PS would be a Satellite 

Positioning System (SPS) such as the Global Positioning 
System (GPS). At present, commercially available 
receivers are capable of providing positional 
information about every second within an X-Y error of 
25 25 meters and with an additional reference receiver at a 

known static location, 2 to 5 meters or less. Z errors 
would be two to three times the X-Y errors. It is 
expected that these errors will decrease in the future 
as PS receiver technology advances. A more detailed 
30 description of an SPS may be gained from GPS. A Guide to 

the Next Utility . Jeff Hurn for Trimble Navigation, 

1989, Trimble Navigation, 645 Mary Avenue, Sunnyvale, 
California 94088. Other examples of Positioning Systems 
include groups of earth-based transmitting beacons at 
35 known locations emitting the necessary coded 

information, and the Soviet orbiting satellite Global 
Navigation System (GLONASS) . 
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Picture Element (pixels . The smallest digital data 
element having information attributes and usually having 
a radiometric resolution of eight bits or one byte for 
display and analysis purposes. 

5 Digital Image . A scene of the earth composed of 

pixels, that have been acquired by digitizing daylight 

bright black and white or color aerial photography, or 

by passive means from a satellite orbiting the earth, 
digitized and transmitted to earth. 

10. Geo-Referenced . Digital imagery, digital data, or 

pixels that can be related to the surface of the earth 
through a map or chart projection system such as 
geographic (longitude, latitude, and altitude) or an 
X-Y-Z system, e.g. , the State Plane (SP) or Universal 
15- Transverse Mercator (UTM) or the like and various 
horizontal and vertical datums such as the North 
American Datum of 1927 (NAD27 ) based on the Clarke 
spheroid of 1866 or NAD83 based on the Geodetic 
Reference System 1980 (GRS80) spheroid or the like and 
20 z values expressed as feet or meters. 

Raster Data . An array or matrix composed of rows 
and columns of digital data elements or pixels having a 
uniform horizontal spacing. 

Vector Data ♦ A group of digital data elements or 
25 pixels occurring randomly and not having a uniform 
horizontal spacing. 

Digital Orthophotograph . A digital image map or 
chart composed of a raster of pixels (derived from 
digitized aerial photography, digital satellite data, or 
30 the like) that have been each geometrically corrected to 
remove all errors due to translations about the x, y, 
and z axes of the imaging platform in relation to the 
plane of the earth at the time of exposure or recording 
and the removal of relief displacement by differential 
35 rectification of each pixel with a geo-referenced array 
of terrain elevations or bathymetric soundings and the 
above computed axial translation constants such that an 
orthorectif ied geo-referenced digital image map or chart 
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is created that is orthogonally correct and has the same 
•orthogonal and accuracy criteria as a conventional 
symbolic map or chart of the same scale and area that 
the digital Orthophotograph portrays. A more detailed 
5 description of digital Orthophotographs may be gained 

from The Production of Orthophotoaraphs bv Digital Image 
Processing Techniques . Leonard Gaydos, Lyman Ladner, 
Richard Champion and David Hooper, Proceedings of the 
Annual Meeting of the ASP-ASCM Convention, Washington, 

10 D.C., March 16-21, 1986, Vol. 4, pp. 241-249. 

Data Laver . A set of geo-referenced digital data 
points having a common theme but differing in value or 
attributes, e.g., a raster of terrain elevation 
attributes (digital elevation map) , a digital 
15 Orthophotograph (raster of brightness value attributes 
for analysis or display) , or a hydrographic or 
transportation network of vector data. Digital data 
layers may be public domain, such as the U.S. Census 
Bureau digital data files, U.S. Geological Survey's 
20 Digital Line Graphs (DLG) and Digital Elevation Models 
(DEM) (arrays of terrain elevations) , or the Defense 
Mapping Agency (DMA) Digital Terrain Elevation Data 
(DTED) , etc. , or proprietary, such as distribution 
routes, timber holdings, socio-economic areas, customer 
25 locations, custom-made high resolution digital data 

layers such as arrays of terrain elevations or below sea 
level (bathymetric) arrays of soundings, etc. 

Geographic Information System fGISl . Computer 
software and hardware, using user input parameters, that 
30 determines relationships, between attributed geo- 
referenced digital data layers covering the same 
geographic coordinate area, be they raster and/or 
vector. Output may be. tables of statistics and/or a new 
geo-referenced digital data layer and/or map or chart 
35 depicting the thematic relationships between the digital 
data layers. Examples of such GIS processed digital 
data layers are population maps, vegetation maps, soil 
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maps, or any map that associates data with geographic 
positions. 

Referring now specifically to FIG. 1, there is 
illustrated the most preferred embodiment of the use of 
5 an SPS and digital Orthophotographs in modes of 

transportation such as ships, aircraft or land vehicles 
or the like. SPS signals are received by SPS 
receiver (s) 1 disposed at one or more locations on the 
mode of transportation. The SPS receiver (s) 1 outputs 
10 its digital latitude(s), longitude(s) , and altitude(s) 

time(s) (LLAT) or X-Y-Z and time positions (XYZT) which 
enter the system controller 2, as well as broadcasting 
the LLATs or XYZTs and identification data of the mode 
of transportation to other systems capable of receiving 
15 this information. Also any LLATs or XYZTs and 

identification data received from other modes of 
transportation or objects equipped to transmit this 
information are entered into the system controller 2. 

The system controller is made up of an interface 3, a 
20 ROM 4 (Read Only Memory) , CPU 5 (Central Processing 

Unit), RAM 6 (Random Access Memory), two Random Access 
Storage Devices (RASDs) 7 and 8, a Bus 9, user input and 
output (I/O) device 10, a digital to analog converter 
(DAC) 11, voice synthesizer 12, graphics controller 13 
25 which could include high-speed digital signal processing 
and advanced graphics algorithms for higher throughput 
in the case of more advanced graphic displays, 
associated graphics memory 14, graphics display 15 
(which could be a three-dimensional image stereo or 
30 holographic heads-up display or other suitable display 
for greater realism) , voice output 16, and optional 
semi-automatic controls 17. The interface 3 passes the 
LLAT or XYZT to the CPU 5 via the Bus 9 where they are 
acted upon by executable programs fetched from RAM 6 and 
35 necessary information for system operation fetched from 
ROM 4 . The CPU 5 executes many programs such as 
obtaining operator parameters from the operator I/O 
device 10 (which comprises a terminal and keyboard or 
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the like), the current SPS LLAT(s) or XYZT(s) , fetching 
the proper digital Orthophotographs and associated 
digital terrain elevation or sounding data from Random 
Access Storage Device 7 for storage in RAM 6, and 
5 subsequent processing by CPU 5 for storage in graphics 

memory 14 and display by the graphics controller 13 to 
the graphics display 15. The LLATs or XYZTs would be 
stored by CPU 5 in Random Access Storage Device 8 for 
later analysis (which could involve, for example, 

10 subsequently combining the data from Random Access 

Storage Device 8 with the appropriate Orthophotographs 
and data layers in order to recreate the mission in a 
similar Orthographic display system). In addition, the 
CPU 5 would invoke user programs to interrogate the 
15 digital terrain elevation and/or sounding data for the • 
possibility of nearby obstacles; and if within user set 
parameters, vocally warn the user through the voice 
synthesizer 12 to the voice output 16. Additionally in 
a similar fashion, the operator can be warned of other 
20 vehicles or structures (which broadcast their 

coordinates and identification data which can then be 
processed by the receiving system and included in the 
visual display so that the navigator is aware of what 
type of vehicle or structure is in proximity, its 
25 distance, its rate of approach, etc.) within a given 

radius. If evasive maneuvers are not undertaken within 
a certain time frame, the CPU 5 can optionally activate 
through DAC 11 semi-automatic control 17 of the mode of 
transportation. Uhen the operator's position is no 
30 longer in the domain of the digital Orthophotographs 

stored in RAM 6, additional Orthophotographs and digital 
terrain elevation and/or sounding data corresponding to 
the operator's new position are fetched from Random ‘ 
Access Storage Device 7 for processing by CPU 5 for 
35 display by graphics display 15. 

Refer now to FIG. 2 which shows a diagram and flow 
of logic through the apparatus shown in FIG. l. The 
CPU 5 first performs an initializing step SI for 
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35 



activating th program and then prompts the operator 
through I/O device 10 for operator input parameters S2 
for user written programs. Input parameters (such as 
the size of the craft, its unique identification number, 
the extremities of the craft, the location (s) of the SPS 
receiver (s ) , etc.) can be a table of types of ships, 
aircraft or land vehicles or the like and their 
associated operational characteristics from which to 
choose. If the precise type is not present, the 
operator may build a table of operational 
characteristics for the operator's mode of transport. 
Other parameters may be whether or not semi-automatic 
control 17 is present and to be activated; presence in 
memory of Orthophotographic map or chart projection, 
code, and spheroid; selection of desired controls and 
methods of displaying the Orthophotographs on the 
graphics display (such methods and controls would 
include generation of stereo Orthophotographs, 
generation of perspective Orthophotographs depending on 
operator input viewing direction and elevation angle, or 



automatic 



calculation from axial translations of x-y-z 



values from SPS receivers (if a receiver is employed at 



more than one location) , or generation of remote 
perspective views of the relationship between the 
surrounding area and the mode of transportation as would 
be seen by an observer at a chosen point in space away 
from the mode of transportation; activation of obstacle 
detection and warning; semi-automatic avoidance; and end 
program! 

A test is made at step S3 to determine if the 
operator wants to end program. If not, the current 
LLAT(s) or XYZT(s) , and current LLATs or XYZT(s) and 
identification data from other nearby modes of 
transportation S4 are obtained from SPS receiver (s) 1 
and transformed (if needed) to the proper projection 
zone, and spheroid of the Orthophotographs and are 
written S5 to Random Access Storage Device 8 for later 
use and analysis. 
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Next a test S6 is made to determine if the proper 
Orthophotographs, digital terrain elevation and/or 
sounding data, and any other relevant operator data sets 
are in memory 6; if not, do data sets exist S7, if not, 

5 notify user S8 visually via graphic display 15 and 

verbally through voice synthesizer 12 and voice 
output 16, and end program; otherwise obtain S9 new data 
set from Random Access Storage device 7 and store in 
RAM 6 before proceeding to S10. 

10 A test is next made S10 to determine if this is the 

initial position; if not, the previous X-Y-Z position 
and time is used with the present ones to calculate Sll 
the present speed, direction and position of the mode of 
transport. Following this, the distances from other 
15 nearby modes of transportation (or structures) emitting 

their own LLATs or XYZTs and identification data are 
determined and the digital terrain elevation and/or 
sounding data is queried S12 using operator parameters 
as to the presence of nearby obstacles. 

20 If other nearby modes of transportation and/or 

obstacles are present S13 , the operator is warned by 
visually indicating and/or emphasizing the impending 
danger on the graphics display 15 and activate S14 voice 
synthesizer 12 and send verbal warning to voice 
25 output 16. If other nearby modes of transportation 

and/or obstacles are critically near S15, as determined 
from operator input parameters, and operator input is 
lacking within a preset time frame, initiate optional 
evasive maneuvers S16 through DAC 11 and semi-automatic 
30 controls 17 using operator parameters. 

Finally, the Orthophotograph, digital terrain 
elevation and/ or sounding data set and any operator 
overlays are processed S17 by CPU 5 for viewing. 
Processing would include the drawing of an overlay 
35 vector from the last SPS position to the present 

position on a graphics overlay.- In addition, this would 
also be done using the LLATs or XYZTs and identification 
data received from other nearby modes of transportation 
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and/or obstacles. Any necessary stereo and/or 
perspective processing required for added realism; 
processing and integration of any operator supplied 
digital data overlays would also be performed by CPU 5. 

5 The processed Orthophotograph and overlays are sent to 
the graphics controller 13 for storage in graphics 
memory 14 and display S18 by the graphics display 15. 

If the operator initiated a user interrupt, this is 
determined at S19 , and steps S2 through S3 are repeated 
10 and optionally S4 through S19. If there is no operator 

interrupt, steps S4 through S19 are repeated 
indefinitely. 

Another embodiment of the invention is its use in a 
static mode as a training simulator, such as a flight 
15 simulator, warfare mission planning, training, and 

attach simulation, and use as entertainment such as in 
video games. In this embodiment the SPS receiver (s) 1 
in FIG. 1, and steps S4 in FIG. 2 are suppressed and 
replaced by X-Y-Z positions and times generated from 
20 user and computer generated data sets. 

In yet another embodiment of the invention, is its 
use as a decision-making tool, rather than primarily as 
a navigation and collision avoidance tool. The 
configurations in FIGS. 1 and 2 remain the same. The 
25 emphasis here is on dynamic decision making by the user. 

An example would be the use of the invention in a land 
vehicle used as a mobile command post during a forest 
fire and could show the user the user's current position 
in the Orthophotograph. User inputs of current 
30 temperature, humidity, wind direction and velocity data, 

vegetation types and combustibility, and transportation 
data layers; this combined with a digital terrain 
elevation data set and its inherent slope and aspect 
information, could be used to compute and display a new 
35 forecast map of the spread of the fire and the user's 

current position. This would aid in timely decision 
making, such as evacuation plans and allocation of 
personnel and resources and the like to fight the fire. 
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In summary, according to the present invention, 
there is provided a positioning, navigation and 
collision avoidance system for various modes of 
transportation utilizing one or more SPS receivers to 
5 gather positional data in conjunction with the use of 
geo-referenced digital Orthophotographs in order to 
present a realistic display of the area surrounding the 
trajectory of the mode of transportation viewed in 
bright daylight regardless of time of day or weather 
10 conditions. Also provided is the capability to 

broadcast the mode of transportation's LLATs or XYZTs 
and identification data to other systems capable of 
receiving this information, as well as the capability to 
receive LLATs or XYZTs and identification data from 
15 other nearby modes of transportation and/or obstacles so 

that the operator's display is supplemented with 
information with respect to other moving objects and 
objects that are not normally included in the digital 
Orthophotographs and their associated elevation maps. 

20 The invention also incorporates the use of an array of 
geo-referenced terrain elevation and/or bathymetric 
soundings from which the Orthophotographs were derived, 
the use of various other operator provided geo- 
referenced digital data layers, and a system controller 
25 to process the above data sets into a meaningful display 
that dynamically shows the operator's position in 
relation to the surrounding terrain or water, and in 
relation to other nearby modes of transportation. 
Additional computer processing of the array of geo- 
30 referenced elevations and/or soundings provides verbal 
and visual information to the operator regarding nearby 
obstacles to avoid, and in extreme cases, optional semi- 
automatic avoidance maneuvers by the mode of 
transportation when operator input is lacking. With the 
35 use of other SPS receiver locations, custom-made high 
resolution Orthophotographs and arrays of. terrain 
elevations and/or soundings including, and if ne ded, 
digitized man-made structures can be utilized for 
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greater resolution, precision and display quality. In 
addition, the array of terrain elevations and/or 
soundings can be used to compute stereo and perspective 
Orthophotographs for display to add greater realism to 
5 the display. The use of a general purpose system 

controller or computer provides the means to store the 
SPS positions, times, velocities, etc., of the mode of 
transportation on a random access device which can be 
subsequently combined with the appropriate 
10 Orthophotographs and data layers to recreate the mission 

for analysis. Computer generated X-Y-Z positions and 
times may be substituted for the SPS receivers and the 
system may be used in a static mode in conjunction with 
a mode of transportation simulator such as a flight 
15 simulator, or in military warfare, mission planning or 

training exercises, or in video games to add greater 
realism to the simulation. The described system may 
also be used as a mobile decision-making tool with the 
use of additional user-supplied geo-referenced digital 
20 data layers with which the geo-referenced 

Orthophotographs and arrays of terrain elevations and/or 
bathymetric soundings are used in conjunction with GIS 
software to generate statistics, new digital data layers 
and/or thematic maps of the surrounding environment, 

25 from which timely and meaningful decisions can be made. 

The foregoing description of the preferred and 
alternative embodiments of the invention have been 
presented for purposes of illustration and description. 
For example, an SPS was cited as the method of obtaining 
30 the spatial and temporal coordinates of the mode of 

transportation, but any PS (Positioning System) or 
combination of PSs could be used in its place. The 
description is not intended to be exhaustive or to limit 
the invention to the precise forms disclosed. - Many 
35 modifications and variations are possible in light of 

the above description. It is intended that the scope of 
the invention be limited not by this detailed 
description, but rather by the claims appended hereto. 
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CLAIMS : 

What is claimed is: 

1. A vehicle position tracking, navigational, 
collision-avoidance and decision support system, 

5 comprising: : 

positioning means for providing positional 
coordinate signals corresponding to spatial coordinates 
of a current position of a vehicle; 

computational -means for accessing an image library 
10 of differentially rectified images for predefined 

geographic areas, indexed by spatial coordinates, and a 
data library of terrain elevational data of said 
predefined geographic areas, indexed by spatial 
coordinates; for receiving said positional coordinate 
15 signals; and for analyzing said positional coordinate 

signals by selecting said differentially rectified 
images from said image library and terrain elevational 
data from said data library; 

processing said positional coordinate signals, said 
. 20 selected differentially rectified images, and said 

terrain elevational data into resultant differentially 
rectified image signals corresponding to the current 
position and terrain of said vehicle; and 

display means responsive to said resultant 
25 differentially rectified image signals for translating 
said resultant differentially rectified image signals 
into visual, pictorial information corresponding to the 
current position and geographic surroundings of said 
vehicle . 

30 2. A method of tracking, navigating, and 

collision- avoidance of a vehicle comprising the steps 
of : 

obtaining positional coordinate signals 
corresponding to spatial coordinates of a current 
position of a vehicle; 

accessing an image library of differentially 
rectified images of predefined geographic areas, indexed 
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by spatial coordinates, and a data library of terrain 
elevational data of same said pred fined geographic 
areas, indexed by spatial coordinates; 

analyzing said positional coordinate signals by 
5 selecting said differentially rectified images from said 
image library and terrain elevational data from said 
data library; 

processing said positional coordinate signals, said 
selected differentially rectified images, and said 
10 terrain elevational data into resultant differentially 
rectified image signals corresponding to the current 
position and terrain of said vehicle; and 

translating said resultant differentially rectified 
image signals into visual, pictorial information 
15 corresponding to the current position and geographic 
surroundings of said vehicle. 

3. The system of claim 1, wherein said positional 
coordinate signals are derived from a positioning 
system. 

20 4. The system of claim 1, wherein said vehicle is 

a ship, aircraft, or land vehicle. 

5. The system of claim 1, wherein said positional 
coordinate signals further include orientation signals 
corresponding to the pitch, roll and yaw of said 

25 vehicle. 

6. The system of claim 1, wherein said spatial 
coordinates are three dimensional, geo-referenced 
coordinates. 

7. The system of claim 1, wherein said image 

30 library of differentially rectified images is derived 

from said data library of terrain elevational data. 
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8. The system of claim 1, wherein said 
differentially rectified images ar digital 
orthophotographs . 

9. The system of claim 1, further comprising 

5 means for generating vehicle signals corresponding to 
structural vehicle parameters, and said computational 
means includes means for receiving said vehicle signals 
and for analyzing said vehicle signals, to provide a 
spatial representation of said vehicle. 

10 10. The system of claim 1, wherein said 

positioning means is operatively coupled to timing means 
for providing timing signals corresponding to the 
temporal coordinates of said vehicle's position. 

11. The system of claim 10, wherein said 

15 computational means further comprises means for storing 
said positional coordinate signals and said timing 
signals of said vehicle's position. 

12. The system of claim 1, wherein said 
positioning means is operatively coupled to transmitting 

20 means for broadcasting said positional coordinate 

signals of said vehicle to other vehicles and structures 
external to said vehicle, and is operatively coupled to 
receiving means for intercepting broadcast position data 
corresponding to spatial coordinates of said other 

25 vehicles and said structures external to said vehicle. 

13. The system of claim 12, wherein said 
computational means further comprises means for storing 
said broadcast position data intercepted by said 
receiver. 



14. The system of claim 12, wherein said 
computational means further comprises means, responsive 
to said broadcast position data intercept d by said 
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receiver, for calculating a distance and rate of 
approach between said vehicle and said other vehicles 
and structures external to said vehicle. 

15. The system of claim 14,. further comprising 
5 means, responsive to said means for calculating a 

distance and rate of approach between said vehicle and 
said other vehicles and structures, for issuing warning 
signals corresponding to a predetermined distance and 
rate of approach between said vehicle and said other 
10 vehicles and structures. 

16. The system of claim 14, further comprising 
means, responsive to said means for calculating a 
distance and rate of approach between said vehicle and 
said another vehicle or structure, for issuing semi- 

15 automatic evasion signals corresponding to a 

predetermined distance and rate of approach between said 
vehicle and said another vehicle or structure. 

17. The system of claim 1, wherein said 
computational means further comprises means for 

20 calculating a distance and rate of approach between said 
vehicle and an obstacle, by interrogating said terrain 
elevational data using said positional coordinate 
signals. 

18 . The system of claim 17 , further comprising 
25 means, responsive to said means for calculating a 

distance and rate of approach between said vehicle and 
an obstacle, for issuing warning signals corresponding 
to a predetermined distance and rate of approach between 
said vehicle and said obstacle. 

19. The system of claim 17, further comprising 
means, responsive to said means for .calculating a 
distance and rate of approach between said vehicle and 
an obstacle, for issuing semi-automatic evasion signals 
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corresponding to a pred termined distance and rate of 
approach between said vehicle and said obstacle. 

20. The system of claim 1, wherein said 
computational means further comprises means, responsive 
5 to said terrain elevational data and said resultant 

differentially rectified image signals, for generating 
perspective views of said visual, pictorial information 
corresponding to the geographic surroundings of said 
vehicle. 

10 21. The system of claim 1, wherein said data 

library of terrain elevational data, further comprises 
three dimensional structure data corresponding to 
digitized man-made structures. 

22. The system of claim 1, wherein said 

15 computational means further comprises means for 

accessing a thematic library of thematic data layers 
corresponding to various predetermined geographic 
thematic relationships of said predefined geographic 
areas, indexed by geo-referenced spatial coordinates; 

20 and for analyzing said positional coordinate signals by 
selecting said differentially rectified images from said 
image library and said terrain elevational data from 
said data library, and said thematic data layers from 
said thematic library, and processing said positional 

25 coordinate signals, said selected differentially 

rectified images, said terrain elevational data, and 
said thematic data layers into resultant differentially 
rectified image signals corresponding to the current 
position and terrain of said vehicle. 

30 23. The system of claim 22, wherein said 

computational means further comprises geographic 
information system means, for analyzing said positional 
coordinate signals by selecting said differentially 
rectified images from said image library, said terrain 
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elevational data from said data library, and said 
thematic data layers from said thematic library, and 
processing said positional coordinate signals, said 
selected differentially rectified images, said terrain 
5 elevational data, and said thematic data layers into 
resultant differentially rectified image signals 
corresponding to the current position and terrain of 
said vehicle. 

24. The system of claim 1, further comprising a 
10 user input coupled to said computational means for 
providing means for entering control signals 
corresponding to input parameters representing 
predefined system functions, system outputs and vehicle 
characteristics . 

15 25. The system of claim 1, wherein said image 

library of said differentially rectified images further 
comprises differentially rectified images of differing 
scales, and wherein said data library of said terrain 
elevational data further comprises terrain elevational 
20 data of differing spatial resolutions. 

26. The system of claim 1, wherein said vehicle is 
a training simulator or video game. 

27. The system of claim 26, wherein said 
positional coordinate signals are derived via said 

25 computational means. 

28. The system of claim 1, wherein said 
differentially rectified images are derived from 
electronic imaging means. 
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